ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

Augmented Language Models (ALMs) blend the reasoning capabilities of Large Language Models (LLMs) with tools that allow for knowledge retrieval and action execution. Existing ALM systems trigger LLM thought processes while pulling observations from these tools in an interleaved fashion. Specifically, an LLM reasons to call an external tool, gets halted to fetch the tool's response, and then decides the next action based on all preceding response tokens. Such a paradigm, though straightforward and easy to implement, often leads to huge computation complexity from redundant prompts and repeated execution. This study addresses such challenges for the first time, proposing a modular paradigm ReWOO (Reasoning WithOut Observation) that detaches the reasoning process from external observations, thus significantly reducing token consumption. Comprehensive evaluations across six public NLP benchmarks and a curated dataset reveal consistent performance enhancements with our proposed methodology. Notably, ReWOO achieves 5x token efficiency and 4% accuracy improvement on HotpotQA, a multi-step reasoning benchmark. Furthermore, ReWOO demonstrates robustness under tool-failure scenarios. Beyond prompt efficiency, decoupling parametric modules from non-parametric tool calls enables instruction fine-tuning to offload LLMs into smaller language models, thus substantially reducing model parameters. Our illustrative work offloads reasoning ability from 175B GPT3.5 into 7B LLaMA, demonstrating the significant potential for truly efficient and scalable ALM systems

Gentopia: A Collaborative Platform for Tool-Augmented LLMs

Augmented Language Models (ALMs) empower large language models with the ability to use tools, transforming them into intelligent agents for real-world interactions. However, most existing frameworks for ALMs, to varying degrees, are deficient in the following critical features: flexible customization, collaborative democratization, and holistic evaluation. We present gentopia, an ALM framework enabling flexible customization of agents through simple configurations, seamlessly integrating various language models, task formats, prompting modules, and plugins into a unified paradigm. Furthermore, we establish gentpool, a public platform enabling the registration and sharing of user-customized agents. Agents registered in gentpool are composable such that they can be assembled together for agent collaboration, advancing the democratization of artificial intelligence. To ensure high-quality agents, gentbench, an integral component of gentpool, is designed to thoroughly evaluate user-customized agents across diverse aspects such as safety, robustness, efficiency, etc. We release gentopia on Github and will continuously move forward

A Novel Role for GADD45\u3ci\u3eβ\u3c/i\u3e as a Mediator of \u3ci\u3eMMP-13\u3c/i\u3e Gene Expression during Chondrocyte Terminal Differentiation

The growth arrest and DNA damage-inducible 45β (GADD45β) gene product has been implicated in the stress response, cell cycle arrest, and apoptosis. Here we demonstrated the unexpected expression of GADD45β in the embryonic growth plate and uncovered its novel role as an essential mediator of matrix metalloproteinase-13 (MMP-13) expression during terminal chondrocyte differentiation. We identified GADD45β as a prominent early response gene induced by bone morphogenetic protein-2 (BMP-2) through a Smad1/Runx2-dependent pathway. Because this pathway is involved in skeletal development, we examined mouse embryonic growth plates, and we observed expression of Gadd45β mRNA coincident with Runx2 protein in prehypertrophic chondrocytes, whereas GADD45β protein was localized prominently in the nucleus in late stage hypertrophic chondrocytes where Mmp-13 mRNA was expressed. In Gadd45β−/− mouse embryos, defective mineralization and decreased bone growth accompanied deficient Mmp-13 and Col10a1 gene expression in the hypertrophic zone. Transduction of small interferin

Prognostic Significance of miR-181b and miR-21 in Gastric Cancer Patients Treated with S-1/Oxaliplatin or Doxifluridine/Oxaliplatin

Background: The goal of this study is to evaluate the effectiveness of S-1/Oxaliplatin vs. Doxifluridine/Oxaliplatin regimen and to identify miRNAs as potential prognostic biomarkers in gastric cancer patients. The expression of candidate miRNAs was quantified from fifty-five late stage gastric cancer FFPE specimens. Experimental Design: Gastric cancer patients with KPS>70 were recruited for the trial. The control group was treated with 400 mg/twice/day Doxifluridine plus i.v. with Oxaliplatin at 130 mg/m 2/first day/4 week cycle. The testing group was treated with S-1 at 40 mg/twice/day/4 week cycle plus i.v. with Oxaliplatin at 130 mg/m 2/first day/4 week cycle. Total RNAs were extracted from normal and gastric tumor specimens. The levels of miRNAs were quantified using real time qRT-PCR expression analysis. Results: The overall objective response rate (CR+PR) of patients treated with S-1/Oxaliplatin was 33.3% (CR+PR) vs. 17.6% (CR+PR) with Doxifluridine/Oxaliplatin for advanced stage gastric cancer patients. The average overall survival for patients treated with S-1/Oxaliplatin was 7.80 month vs. 7.30 month with patients treated with Doxifluridine/Oxaliplatin. The expression of miR-181b (P = 0.022) and miR-21 (P = 0.0029) was significantly overexpressed in gastric tumors compared to normal gastric tissues. Kaplan-Meier survival analysis revealed that low levels of miR-21 expression (Log rank test, hazard ratio: 0.17, CI = 0.06-0.45; P = 0.0004) and miR-181b (Log rank test, hazard ratio: 0.37, CI = 0.16-0.87; P = 0.018) are closely associated with better patient's overall survival for both S-1 and Doxifluridine based regimens. Conclusion: Patients treated with S-1/Oxaliplatin had a better response than those treated with Doxifluridine/Oxaliplatin. miR-21 and miR-181b hold great potential as prognostic biomarkers in late stage gastric cancer. © 2011 Jiang et al

An increased abundance of tumor-infiltrating regulatory t cells is correlated with the progression and prognosis of pancreatic ductal adenocarcinoma

CD4+CD25+Foxp3+ regulatory T cells (Tregs) can inhibit cytotoxic responses. Though several studies have analyzed Treg frequency in the peripheral blood mononuclear cells (PBMCs) of pancreatic ductal adenocarcinoma (PDA) patients using flow cytometry (FCM), few studies have examined how intratumoral Tregs might contribute to immunosuppression in the tumor microenvironment. Thus, the potential role of intratumoral Tregs in PDA patients remains to be elucidated. In this study, we found that the percentages of Tregs, CD4+ T cells and CD8+ T cells were all increased significantly in tumor tissue compared to control pancreatic tissue, as assessed via FCM, whereas the percentages of these cell types in PBMCs did not differ between PDA patients and healthy volunteers. The percentages of CD8 + T cells in tumors were significantly lower than in PDA patient PBMCs. In addition, the relative numbers of CD4+CD25+Foxp3+ Tregs and CD8+ T cells were negatively correlated in the tissue of PDA patients, and the abundance of Tregs was significantly correlated with tumor differentiation. Additionally, Foxp3+ T cells were observed more frequently in juxtatumoral stroma (immediately adjacent to the tumor epithelial cells). Patients showing an increased prevalence of Foxp3+ T cells had a poorer prognosis, which was an independent factor for patient survival. These results suggest that Tregs may promote PDA progression by inhibiting the antitumor immunity of CD8+ T cells at local intratumoral sites. Moreover, a high proportion of Tregs in tumor tissues may reflect suppressed antitumor immunity. Copyright: © 2014 Tang et al

Guidelines for the use and interpretation of assays for monitoring autophagy (3rd edition)

In 2008 we published the first set of guidelines for standardizing research in autophagy. Since then, research on this topic has continued to accelerate, and many new scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Accordingly, it is important to update these guidelines for monitoring autophagy in different organisms. Various reviews have described the range of assays that have been used for this purpose. Nevertheless, there continues to be confusion regarding acceptable methods to measure autophagy, especially in multicellular eukaryotes. For example, a key point that needs to be emphasized is that there is a difference between measurements that monitor the numbers or volume of autophagic elements (e.g., autophagosomes or autolysosomes) at any stage of the autophagic process versus those that measure fl ux through the autophagy pathway (i.e., the complete process including the amount and rate of cargo sequestered and degraded). In particular, a block in macroautophagy that results in autophagosome accumulation must be differentiated from stimuli that increase autophagic activity, defi ned as increased autophagy induction coupled with increased delivery to, and degradation within, lysosomes (inmost higher eukaryotes and some protists such as Dictyostelium ) or the vacuole (in plants and fungi). In other words, it is especially important that investigators new to the fi eld understand that the appearance of more autophagosomes does not necessarily equate with more autophagy. In fact, in many cases, autophagosomes accumulate because of a block in trafficking to lysosomes without a concomitant change in autophagosome biogenesis, whereas an increase in autolysosomes may reflect a reduction in degradative activity. It is worth emphasizing here that lysosomal digestion is a stage of autophagy and evaluating its competence is a crucial part of the evaluation of autophagic flux, or complete autophagy. Here, we present a set of guidelines for the selection and interpretation of methods for use by investigators who aim to examine macroautophagy and related processes, as well as for reviewers who need to provide realistic and reasonable critiques of papers that are focused on these processes. These guidelines are not meant to be a formulaic set of rules, because the appropriate assays depend in part on the question being asked and the system being used. In addition, we emphasize that no individual assay is guaranteed to be the most appropriate one in every situation, and we strongly recommend the use of multiple assays to monitor autophagy. Along these lines, because of the potential for pleiotropic effects due to blocking autophagy through genetic manipulation it is imperative to delete or knock down more than one autophagy-related gene. In addition, some individual Atg proteins, or groups of proteins, are involved in other cellular pathways so not all Atg proteins can be used as a specific marker for an autophagic process. In these guidelines, we consider these various methods of assessing autophagy and what information can, or cannot, be obtained from them. Finally, by discussing the merits and limits of particular autophagy assays, we hope to encourage technical innovation in the field

Enhancing Team Member Proactivity Through Career Calling and Mentoring: A Time-Lagged Study

Team member proactivity has become increasingly important for contemporary teams that seek to improve how they function. However, for team members, this proactive team-oriented behavior requires risk taking and a great amount of effort; therefore, organizations must encourage persistence in this behavior. This is the first study to propose that organizations can enhance team member proactivity when they help team members live out their individual callings by offering them mentoring. Our hypotheses are tested by using a multi-source and time-lagged study design with a sample of 296 Chinese employees and their direct supervisors. The results demonstrate the importance of adding career calling constructs as antecedents to the team member proactivity literature and suggest that organizational resources such as mentoring are needed to facilitate the link between team member proactivity and career calling.

Study of Coating Weight and Utilization Rate in the Modification of Ground Calcium Carbonate

Ground calcium carbonate (GCC) was modified in this work using starch, sodium stearate, and sodium hexametaphosphate. The effects of reaction temperature and the dosage of sodium hexametaphosphate on the coating weight of modified GCC and the utilization rate were considered. The strength (tensile, burst, and tear) of papers filled with modified GCC vs. unmodified GCC was compared. The research showed that lower precipitation reaction temperature was conducive to the increase of modified GCC coating weight and the complex utilization rate. A proper dosage of sodium hexametaphosphate could effectively increase the coating weight of modified GCC and the complex utilization rate. Compared with unmodified GCC filled papers, modified GCC filled papers performed better with respect to paper strength, but the optical properties (brightness and opacity) showed the opposite trend